Joint quantile regression in vector-valued RKHSs
نویسندگان
چکیده
Addressing the will to give a more complete picture than an average relationship provided by standard regression, a novel framework for estimating and predicting simultaneously several conditional quantiles is introduced. The proposed methodology leverages kernel-based multi-task learning to curb the embarrassing phenomenon of quantile crossing, with a one-step estimation procedure and no post-processing. Moreover, this framework comes along with theoretical guarantees and an efficient coordinate descent learning algorithm. Numerical experiments on benchmark and real datasets highlight the enhancements of our approach regarding the prediction error, the crossing occurrences and the training time.
منابع مشابه
Data sparse nonparametric regression with $ε$-insensitive losses
Leveraging the celebrated support vector regression (SVR) method, we propose a unifying framework in order to deliver regression machines in reproducing kernel Hilbert spaces (RKHSs) with data sparsity. The central point is a new definition of -insensitivity, valid for many regression losses (including quantile and expectile regression) and their multivariate extensions. We show that the dual o...
متن کاملVector Quantile Regression
We propose a notion of conditional vector quantile function and a vector quantile regression. A conditional vector quantile function (CVQF) of a random vector Y , taking values in R given covariates Z = z, taking values in R, is a map u 7→ QY |Z(u, z), which is monotone, in the sense of being a gradient of a convex function, and such that given that vector U follows a reference non-atomic distr...
متن کاملConsistency of kernel-based quantile regression
Quantile regression is used in many areas of applied research and business. Examples are actuarial, financial or biometrical applications. We show that a non-parametric generalization of quantile regression based on kernels shares with support vector machines the property of consistency to the Bayes risk. We further use this consistency to prove that the non-parametric generalization approximat...
متن کاملSemiparametric Quantile Regression with High-dimensional Covariates.
This paper is concerned with quantile regression for a semiparametric regression model, in which both the conditional mean and conditional variance function of the response given the covariates admit a single-index structure. This semiparametric regression model enables us to reduce the dimension of the covariates and simultaneously retains the flexibility of nonparametric regression. Under mil...
متن کاملDEPARTMENT OF ECONOMICS WORKING PAPER SERIES Two Stage Semi Parametric Quantile Regression
We propose a root n consistent estimator for β0 when the qth conditional quantile of Y given X=x and Z=z takes the semi linear form g(x)+z′β0 where g(.) is an unknown real valued function,β0 a finite dimensional parameter and (X,Z)a couple of explanatory variables.Importantly, our estimator attains,under homoscedasticity,the semi parametric efficiency bound.This estimation is conducted in two s...
متن کامل